Although the k statistic has been used widely as an indicator of rater agreement, there have been some concerns about the existence of different definitions and some peculiar results involving skewed data. This note evaluates different definitions of k and also demonstrates that the problem with directly comparing k values, especially for skewed data, can be avoided by comparing their significance.